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Motion binning s 



The invention relates to a method of generating motion bhar in a gr^hics 
system, and to a gt^Mcs computer system. 



5 Usually, images are displayed on a display screen of a display ^aratus in 

successive fiames of lines. 3D objectsTfisplayed on the display screen which move with a 
large speed have a large ftame to fiame displacement This is in particular the case fer 3D 

games. The large displacement may lead to visual artifects, often referred to as Uaaapaaa 
aUasmg. Temporal ffltering, which adds blur to flie hnages, alleviates tiiese artifects. 
10 An expensive approach to alleviate ten^oralaKaang is to increase tiie fiame 

rate such tiiat the motions of the objects result m smaller ftame to ftame di^lacements. 
However, a high reftesh rate requires an e:q>ensive display ^aratus capable to display 

images with fliese high reftesh rates. 

Anotiier approach is ten^oral super-sampling wherein the images are rendered 
15 multiple times wilhin flie ftame display time interval. The rendered images are averaged and 
Aen displayed. This ^»pioadi requires tiie 3D appUcation to send tiie geometry for several 
instances witiiin tiie ftame to ftame hrterval which requires a very powerM processing. 

A cost effective solution is to average a present image during tiie present 
ftame witii tiie previous displayed image of tiie preceding fiame. This ^»proacli provides an 
20 ^proximation of motion bhir only, it does not provide a satisfectory quality of tiie images. 

US-B-6,426,755 discloses a gr^hics system and mefliod fiw performmg blur 
effects. In one embodiment, tiie system«omprises a gr^hics processor, a sample buffer, and 
a sample-to-pixel calculation unit The gr^hics processor is configured to render a pluiaKty 
of samples based on a set of received tiiree-dimensional gr^hics data. The processor is also 
25 configured to generate sample tags for flie samples, wherem tiie sample tags are indicative of 
whether or not tiie sanqiles ace to be blurred. The super-sampled sample buffer recdves and 
stores tiie samples ftom tiie gr^hics processor. The sample-to-pixel calculation unit receives 
and filters tiie samples ftom flie super-sanq)led sample buffer to generate output pixels which 
form an image on a display device. The sanq?le-tOi?ixel calculation units are configured to 
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select the filter attdbutes used to filter the samples into ou^ut pixels based on the ssax^le 



5 ft is an object ofiheinventkm to add the blm dining a rasterization operation 

- with a one-dimensional filter. 

A first aspect of the invention provides a me&od of generating motion blur in 
a gr^ihics system as claimed in claim 1. A second aspect of the invention provides a 
counter graphics system as claimed in claim 13. Advantageous embodiments are defined in 
10 die dependent claims. 

In Ihe method of generating motion blur in a gr^hics system in accordance 
with the first aspect of the invention, geometrical information defining a shape of a graphics 
primitive is received, this geometiical information may be the three-dunensional graphics 
data referred to in US-B-6,426,755. It is also possible to use two-dimensional gr^hics data 

15 which is suppUed by an plication in a system which has less processing recourses. The 
method uses displacement information determining a disfplacement vector defining a 
direction of motion of the gr^hics primitive to sample the gr^hics primitive in the direction 
of the motion to obtain input samples. A one dimensional spatial fihering of flie irqmt 
samples provides die temporal filtering. In this manner a high quality blur is obtained without 

20 requiring complex processing and filtering. 

A simple one dimensional filter is used without requiring redundant 
calculations. In contrast, the post-processmg of US-B-6,426,755 has to calculate a two- 
dhnensional filter wi& a per pixel varying direction and amount of filtering. The ^roach in 
accordance with the invention has the advantage that sufficient motion blur is introduced in 
25 an effective manner. It is not required to increase the fiame rate, nor to increase the temporal 
sample rate, the quality of the images is better flian obtained by the prior art averaging. 

• A further advantage is that this ^roach can be iniplemented in the well. 

known inverse texture mapping approach as claimed in claim 6, and in the forward texture 
m^ing ^jproach as claimed in claim 7. The known inverse naming qjproach and the 

30 foiward texture mapping approach as such wiU be ehiddated in more detail with reaped 
Figures 2 and 4. 

In. an embodiment in accordance with the invention as defined in claim 2, the 
fiwtprint of the one-dimensional filter varies with tihe magnitude of the displacement vector 
and thus wifli the motion. This has the advantage that the amount of blur introduced is 
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ccmelated wifli ftie amount of displacemeirt of a graphics primitive. If a low amount of 
movement is present, only a low amount of blur is introduced and a high amount of sharpness 
is preserved If a high amount of movement is present, a high amount of blur is introduced to 
s»q,pcess the temporal aUasing aitifects- Thus, an optimal amount of bhir is p^^ 
5 easy to vary the amount of filtering because a one-dimensional filter is required only. 

In an embodiment in accordance with Ihe invention as defined in claim 3, the 
displacement vector is supplied by the 2D (two-dimensional) or 3D (three-dimensional) 
plication which, for example, is a 3D game. This has the advantage feat the programmers 
of fee 2D or 3D ^Kcation have foil control over fee displacement vector and feus can steer 
10 fee amount of blur introduced. 

In an embodiment in acoAdance wife fee hivention as defined in claim 4, fee 
2D or 3D ^Ucation provides information which defines fee position and fee orientation of 
fee graphics primitives during a previous fiame. The method of generating motion blur in 
accordance wife an embodiment of fee invention determines fee displacement vector of fee 
15 gr^hics primitives by comparing fee position and the orientation of fee graphics primitives 
in fee present ftame wife fee position andfee orientation of fee gr^hics primitives of fee 
previous ftame. This has fee advantage feat fee displacement vectors do not have to be 
calculatedby fee 3D ^plication in software, but instead fee geometry acceleration hardware 
can be used for determining fee displacement vectors. 

hi an embodiment in accordance wife fee invention as defined in claim 5, fee 
buffering of fee position and fee orientation of fee graphics primitives during fee previous 
ftame is performed by fee mefeod of generating motion blur in accordance wife fee 
invention. This has fee advantage that a standard 3D ^Kcation can be used, fee 
displacement vectors are completely detemiined by fee mefeod of generating motion blur in 

25 accordance wife the invention. 

In an embodiment m accordance wife fee invention as defined in claim 6, fee 
mefeod of generating motion blur is hnplemented in fee weE know inverse texture moping 
approach. 

The intensities of fee pfacels present in fee screen space define fee displayed 
30 imageonfeescreen.UsuaUy,feepixelsareactaallypositioned(inamatrixdisplay)or 

feou^ to be positioned (in a CRT) in an orfeogonal matrix mdicated by an orfeogonal x and 
y coordmate system. In fee embodiment in accordance wife fee invention as defined in claim 
6, fee X and y coordinate system is rotated such that fee screen displacement vector in fee 
sLeen space occurs in fee direction of fee x-axis. Therefore, fee sampling is performed in fee 
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screen space in the direction of the screen displacement vector. The gr^hics primitive in the 

-^.--•--screen-space is the-realwori^^ 

rotated screen space. Usually, the gr^hics primitive is a polygon. The screen dis3>]acement 
vector is the displacement vector of the eye space graphics primitive m^ed to the screen 

5 space. Hie eye space gc^hics primitive is also referred to as the real world gr^hics 

P^tive, which ^es not Mcste that a ph^ obj«jtjs nMmt,.il^ objects are. - 

covered. The sampling provides coordinates of the resampled pixels which are used as input 
samples for the mverse texture m^ing, instead of the coordinatBS of the pixels in the non- 
rotated coordinate system. 

^® l^en, the well known inverse texture mapping is applied. A bluiring-filter 

which has a footprint in the rotated coordinate system, is allocated to the pixels. The pixels 
within the footprint will be filtered in accordance with the blurring-filter ampKtude 
characteristics. The footprint in the screen space is m^iped to the texture space and called the 
m^yped footprint Also the polygon in the screen space is nuqpped to the texture space and 

15 called the m^ed polygon. The texture space comjirises the textures v«*ich should be 

displayed on the surfece of the polygon. These textures are defined by texel intensities stored 
in a texture memory. Thus, the textures are ^earance information which define an 
appearance of the gr^hics primitive by defining texel intensities in a texture space. 

The texels bofli felling withm the mapped footprint and wilhin the m^ed 

20 polygon are determined, the mq»ped blurring-filter is used to weight the texel intensities of 

these texels to obtain tiie intensities of ihe pixels in the rotated coordinate system (tiius, the 
intensities of the resampled pfacels instead of flie intensities of the pixels in the well known 
inverse texture m^ing wherem the coordinate system is not rotated). 

The one-dimensional filtering averages Ihe intensities of tiie pixels in tiie 
25 rotated coordinate system to obtain averaged intensities. A resampler resamples tiie averaged 
pixel intensities of tiie resampled pixels to obtain flie intensities of tiie pixels in tiie original 
non-rotated coordinate system fiiom the averaged intensities. 

In an embodiment in accordance with Ihe invention as defined m claim 7, the 
mefliod of generating motion blur is implemented m tiie forward texture m^jping ^jproach. 

30 texture space tiie texel intensities offliegr^Mcs primitive in file texture 

space are resanqiled in tiie direction of a texture displacement vector to obtain resampled 
texels (RTi). The texel displacement vector is tiie real world displacement vector mapped to 
tiie texel space. The texel intensities, which are stored m a texture memory, are inteipolated 
to obtain tiie intensities of tiie resampled texels. The one-dimensional spatial filtering 
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averages the intensities of the resampledtexels in accoidance with a weighting fimction to 
obtain filtered texels. The filtered texels of flie gr^Mcs primitive are ni^>ped to the screen 
space to obtain mapped texels. The intensity contributions of am^edtexel to all the pixels 
of which a corresponding pre-filter footprint of a pre-filter covers tiie m^ed texel is 
5 determined. The contribution of a mapped texel to a particular pbcel depends on the 

dharacteristic of the pre-filter. For each pbcel, the intensity contributions of the nMqM)ed texels 
are summed to obtain the intensity of each one of the pbtels. 

Thus, said m other words, the coordinates of texels within the polygon in 
texture space are m^ped to the screen space, and a contribution from a m^ed texel to all 
10 Ae pixels of which the correspondmg pre-filter fi>otprint covers tiiis texel is determined in 
accordance with the filter characteristic fi>r this texel, and finally all the contribution of the 
texels are summed for each pixel to obtain the pixel intensity. 

In an embodiment m accordance witii tiie invention as defined in daim 8, the 
displacement vector of tiie gr^hics primitive is determined as an average of flie displacement 
15 vectors of vertices of the graphics primitive. This has tiie advantage that only a smgjle 
displacement vector for each polygon is required, which displacement vector can be 
determined in an easy manner. It suffices if the directions of the displacement vectors of the 
vertices is averaged. The magnitude of tiie displacement vector may be interpolated over tiie 
polygon. 

20 In an embodiment m accordance with flie invention as defined m claim 9, the 

intensities of tiie tesampled pixels are distributed, in the screen space, in a direction of the 
displacement vector in the screen space over a distance determined by a magnitude of tiie 
displacement vector to obtain distributed intensities. The overlying distributed mtensities 
of difierent paels are averaged to obtain a piece-wise constant signal which is tiie averaged 

25 intBnsitym8creenq»ce.Thishastheadvantagpthatashutterbdiaviorofacamerai8 

resembled, tiius providing a very acceptable motion blur. 

In an embodiment in J«ccordance with the invention as defined in claim 10, the 
the intensities of the resampled texels are distributed, m tiie texture space, in a direction of 
the displacement vector in tiie texture space over a distance determined by a majpitude of tiie 
30 displacement vector to obtain distributed intensities. The overlying distributed intensities 
of difierent resampled texels are averaged to obtain a piece-wise constant signal which is tiie 
averaged intensity in tiie texture space (also referredto as filtered texel). This has tiie 
advantage tiiat a shutter behavior of a camera is resembled, tiiusproviding a very acceptable 
motion blur. 
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In an embodiment in accordance wifli the invention as defmed in claim 1 1, the 
- - - - one=dimensional spatial-ffltCTin g-^aTOTiCTiff^^ 

mote fiame-to-ftaine intervals. This has the advantage that although in each fiame an • 
efficient one-dimensional filter is perftinned, a higjier-order temporal filtering is obtained. At 
5 the rendering of the fitume, only partial intensities of the pixels axe calculated which have to 
- - be stOTed. The PKel mteMitira^f^^^ ftana^S have to.]^_^^<aimulated.to.ob1am flie . 

correct pixel intensities. In this case, n is the width of the temporal filter. The higher-order 
filtering provides less aliasing with a same amount of blur, or, equivalently, a reduced blur 
with the same amount of tenxpoial aliasing. 
10 In an embodiment in accordance with the invention as defined in claim 12, the 

distance over which the resampled pixels or the resampled texels are distributed is rounded to 
a multiple of the distance between resampled texels. This avoids a doubling of the number of 
resampled texels during the accumulation of the distributed intensities of the texels. 

These and other aspects of the invention are apparent J&om and will be 
15 elucidated with reference to the embodiments described h^emafter. 



hi the drawings: 

Fig. 1 elucidates a displ^ of a real worid 3D object on a display screen. 
Fig. 2 elucidates the known inverse texture mapping 

I'jg' 3 shows a block diagram of a dscuit for performing the known inverse 
texture m^jping, 

Fig. 4 elucidates the forward texture mapping. 

Fig. 5 shows a block diagram of a circuit for performing the forward texture 

mapping. 

Fig. 6 shows a block diagram of a circuit in accordance with an embodiment 
of the invention, — 

Fig. 7 elucidates the sampling in the direction of the displacement vector in Ihe 

screenspace. 

Fig. 8 shows a block diagram of a drcuit in accordance with an embodiment 
of the invention contprising the inverse texture m^ing, 

Fig. 9 elucidates the sampling in the direction of the displacement vector m the 

texture space, 
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Fig. 10 shows ablock diagram of a drcirit in accordance with an embodiment 

of the invention comprising forward texture mapping. 

Fig. 1 1 shows an embodiment of a blurring filter with a foo^oint. 

Fig. 12 shows the determination of a displacement vector of a polygon based 

on the displacement vectors of vertices of the polygon. 

Fig. 13 shows the temporal pie-filtering using sti^tched texels in accordance 

with an embodiment of the mvention, and 

Fig. 14 shows tiie ^proximation of motion blur of a camera by using tiie 
stretched texels in accordance with an embodiment of the hivention. 



10 



Fig. 1 eluddates a display of a real world 3D object on a display screen. A real 
world object WO, which may be a three-dimensional object such as Ihe. cube shown, is 
projected on a two-dimensional display screen DS. Tbe tin«e.dimensional olqect WO has a 

15 surfece stmcture or texttire whicb defines the ^aiance of tiie toe-dimensional object 
WO . In Fig. 1 tiie polygon A bas a texture TA and tiie polygon B has a lextare TB. The 
polygons A andB are witii amore general term also referred to as tiie real woridgr^s 

primitives. 

The projection of tiie real world object WO is obtained by defining an eye or 
20 camemposition ECP witii respect to tiie screen DS. In Fig. 1 is shown how flie polygon SGP 
corresponding to tiie polygon A is projected on tiie screen DS. The polygon SGP in tiie 
screen space SSP defined by tiie coordinates X and Y is also referred to as a graphics 
primitive instead of tiie graphics primitive in fiie screen space. Thus, witii gr^hics primitive 
is indicated tiie polygon A in tiie eye space, or tiie polygon SGP in tiie screen space, or tiie 
25 polygon TOT in tiie texture space, it is clear fiom tiie context which gn?>hics primitive is 
meant It is only tiie geometry of tiie polygon A wWch is used to determine tiie geometry of 

tiie polygon SGP. Usually, it suffices to.know tiie vertices of tiie polygon A to determine tiie 

vertices of the polygon SGP. 

The texture TA of tiie polygon A is not dnectiy projected firan tiie real world 
into tiie screen space SSP. The different textures of tiie real world object WO are stored in a 
texture map or texture space TSP defined by tiie coordinates U and V. For example. Fig. 1 
shows tiiat tiie polygon A has a texture TA which is available in tiie texture space TSP in tiie 
area indicated by TA while tiie polygon B has anotiier texture TB which is available in tiie 
texture space TSP in tiie area indicated by TB . The polygon A is proj ected on tiie texture 
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space TA such that a polygon TGP occurs such that when the texture present within the 
- polygonTOP is projected on theijol y go^ 



obtained or at least resembled as much as possible. A perspective ttansfijnnation PPT 
between the texture space TSP and the screen q>ace SSP projects the texture of tbe polygon 
5 TGP on the corresponding polygon SOP. This process is also refened to as texture mappmg. 

1?^^' ^ S^otial tejrt^ sverytexture defines-its-= 

own texture space. 

Fig. 2 elucidates the known mverse texture mapping. Fig. 2 shows the polygon 
SGP in the screen space SSP and the polygon TGP in the texture space TSP. To feciHtate the 
10 elucidation, it is assumed that both the polygon SGP and Ihe polygon TGP correspond to the 
pol/gon A of the real world object WO of Fig. 1. 

The intensities PD of the pixels Pi present in the screen space SSP define the 
image displayed. Usually, the pixels H are actually positioned (in a matrix display) or 
thought to be positioned (in a CRT) in an orthogonal matrix of positions. In Fig. 2 only a 
15 limited number of the pixels Pi is indicated by the dots. The polygon SGP is shown in the 
screen space SSP to indicate which pixels Pi are positioned within the polygon SGP. 

The texels or texel intensities Ti m the texture space TSP are indicated by the 
intersections of flie horizontal and vertical lines. These texels Ti which usually are stored in a 
memory called texture m^ define the texture. It is assumed that the part of the texel m^ or 
20 texure space TSP shown corresponds to fhe texture TA shown in Fig. 1. The polygon TOP is 
shown m the textme space TSP to indicate which texels Ti are positioned within the polygon 
TGP, these texels Ti are indicated by small crosses. 

The weU known inverse texture m^mg comprises the steps elucidated in the 
. now following. A bluring-filter vMch has a footprint FP is shown in the screen space SSP 
25 and has to operate on the pixels Pi to perform a weighted averaging operation required to 
obtain the blurring. This footprint FP in the screen space SSP is mapped to the texture space 

TSP and caUed the mapped footprint MFP. The polygon TGP which may be-obtained by 
m^ing the polygon SGP from the screen space SSP to the texture space TSP is also called 
the m^ed polygon. The texture space TSP cofflprises the textures TA, TB (see Fig. 1) 
30 which should be displayed on the sun^ of the polygon SGP. As described above, these 
textures TA, TB are defined by texel intensities Ti stored in a texel memory. Thus, &e 

textures TA, TB are ^earance information which define an ^rpearance of the gr^hics 
primitive SGP by defining texel intensities Ti m a texture space TSP. 
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Tlie texels Ti bofli felling within fhe m^»ped foo4«int MFP and within the 
m^ed polygon TOP are detemmied. These texels Ti are indicated by the crosses. The 
m^ped blurring-fflter MFP is used to wd^t the texel intensities Ti of these 

obtain the intensities of the pixels Pi. 
5 .Fig.3showsablockdiagramofacircuitforperfiwmingflieknowninverse 

textuie mqjping. The circuit comprises a rasterizer RSS which operates in Ae screen space 
SSP, a resanqiler RTS in the textuie space TSP, a textuie memory TM and a pixel ftagment 
jaoiessmg drcuit PFO. Ut, Vt is the texture coordinate of a lexel Ti with index t, Xp, Yp is 
the screen coordinate of a pixel whh index p. It is the color of the- texel Ti with index t. and Ip 
10 is flie filtered color ofpfaffil Pi with index p. 

The rasterizer RSS rasterizes the polygon SGP in flie screen space SSP. For 
every iMxel Pi traversed, its blurring filter foolprint FP is m^T^ 

The texels Ti witiun the mapped foo^ MFP and vwlhin Ihe m^ed polygon TOP are 
determined and weightedaccordingto am^profile of Ihebhurh^ filter. The ^^^^ 

15 pixelsPiiscomputedusingthemappedblurringfilterinfhetexture^TSP. 

Thus, the rasterizer RSS recaves the polygons SGP in Ihe screen space SSP to 
supply ihe m^edblurring filter footprint MFP and the coordinates of flie pixels Pi. A 
desampler in the texture space RTS receives the m^ed blurring filter foolprint MFP and 
information on the position of thepolygon TGP 1o determine which texels Ti are wiflrin the 

20 m^ed feo^t MFP and wito the polygon TGP. The mtensities of the texels Ti 
determined in tins manner are retrieved ftom Ihe texture memory TM. The blur^^ 
filters flie relevant intensities of the texels Ti determmed in this manner to s,qq?ly Ihe ffl^ 

color Ip of the pixel Pi. 

The pixel ftagment processme circuit PFO provides an hnproved processing 
25 of pUds near 1» borders of flie polygon SGP and suppHes Ae pixel mtensities Pfi of the 
pfacels Pi displayed on the screen DS. The pixel ftagment processing circuit PFO blends the 
blur if several polygons are movmg. • - 

Fig. 4 elucidates fi»rwaid texture map^s- Fig- 4 shows Hie polygon SGP in 
the screen space SSP and the polygon TOP in flie textnre space TSP. To fecilitate the 
30 elucidation, it is assumed fliat both &e polygon SGP and the polygon TOP correspond to the 
polygon A of the real world object WO of Fig. 1. 

The intensities Pli of the pixels Pi present m the screen space SSP define the 
image displayed The pixels Pi are mdicated by the dots. The polygon SGP is shown in the 
screen space SSP to indicate which pixels Pi are positioned within the polygon SGP. The 
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pixel actuaDy indicated by Pi is positioned outside the polygon SGP. With each pixel Pi a 
Hfootprin^FP o^a-blur fflter is assoCT - - 3- .^r=:^^=^==-=.r-^.=^-^-. ^^.^..^ ^--^--...^^ 

texels or texel intensities Ti in the texture space TSP are indicated by the 
interstices of the horizontal and vertical lines. Again, fliese texels Ti which usually are stored 
in a memoiy called texture define the texture. It is assumed that the part of flie texel 

sh ow n c orresfponds to fte tertiro TA^^ .1. The polygon-TGP- 

is dhown in flie texture space TSP to indicate which texels Ti are positioned within tiie 
polygon TGP. 

The coordinates of the texels Ti within the polygon TGP are mapped 
(resampled) to the screen space SSP. In Kg. 4, this m^ing (indicated by the arrow AR from 
the texture ^ace TSP to the screen space SSP) of a texel Ti (indicated by a cross in the 
textare space) to the screen space SSP provides mapped texels MTi (indicated by the cross in 
the screen space SSP, which cross may be positioned in-between pixel positions indicated by 
the dots) in the screen space SSP. A contribution of the m^>ped texel MTi to all the pixels H 
15 which have a footprint FP of flxe blur filter which encon5)ases the mqjped texel MTi is 

determined in accordance with the filter characteristic of the blur filter. AH the contributaons 
of the m^ed texels MTi to the pixels Pi are summed to obtain the intensities PH of the 
pixels Pi. 

In the forward texture m^>pmg, the resampling fiom the colors of the texel Ti 
20 to flie colors of the pixels Pi occurs in the screen space SSP, and thus is input sample driven. 
Compared to the mverse texture m^jping, it is easier to determine which texels Ti contribute 
to a particular pixel Pi. Only the mq>ped texels MTi which are within a footprint FP of the 
blurring fiher for a particular pixel Pi will contribute to flie mtensity or color of this particular 
pixel Pi. Further, there is no need to transform the blurring filter fiom the screen space SSP to 
25 the texel space TSP. 

Fig. 5 shows a block diagram of a circuit for performing the forward texture 
mapping. The circuit comprises a rasterizer RTS which operates m the texture space TSPi a 
resampler RSS in the screen space SSP, a texture memory TM and a pixel fragment 
processing circuit PFO. Ut, Vt is the texture coordmate of a texel Ti with mdex, Xp, Yp is the 

30 screen coordmateofapixelwithindexp,ItisthecoloroflhetexelTiwifhmdext,and^is 
the filtered color of pixel Pi with index p. 

The rasterizer RTS rasterizes the polygon TGP in fbe texture space TSP. For 
every texel Ti which is withm the polygon TGP, tiie resan^ler in the screen space RSS maps 
the texel Ti to a m^ed texel MTi in the screen space SSP. Further, the resampler RSS 
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detennines the contribution of a mai>ped texel MTi to all the pixels Pi of which the associated 
foo^piint FP of the bluiring filter encompasses this mapped texel MTi. Finally, the resampler 
RSS sums the intensity contribulions of all m^ed texels MTi to'the pixels Pi to obtain the 
intensities PB of flie pixels Pi. . 
5 Hie pixel j&agment processing circuit PFO provides an improved processing 

of pixels near to borders of the polygon SGP and supplies the pixel intensities Pli of the 
pixels Pi displayed on the screen DS. 

Fig. 6 shows a block diagram of a circuit in accordance with an embodiment 
of the invention. This motion blur generating circuit comprises a rasterizer RA, a 
10 displacement providing circuit DIG, and a one-dimensional filter ODF. 

The rasterizer RA receives both geometrical information GI which defines the 
shape of a gr^hics primitive SGP or TGP and displacement information DI which 
determines a displacement vector defining a direction of Hie motion of the grsq^hics primitive 
SGP or TGP. The rasterizer RA samples the graphics primitive SGP or TiGP in the direction 
15 of the displacement vector to obtain san:ples RPi. The one-dimensional filter ODF provides a 
temporal pre-filtering by filtering the samples RPi to obtain averaged intensiti 

The rasterizer RA may operate in tiie screen space SSP or in the texture space 
TSP. If ihc rasterizer RA operates in the soeen space SSP, the grsqphics primitive SGP or 
TGP may be the polygon SGP, and the samples RPi are based on the pixels PL If the 
20 rasterizer RA operates in the texture space TSP, the graphics primitive SGP or TGP may be 
the polygon TGP, and the samples RPi are based on the texels Ti. 

The use of a rasterizer RA in the screen space SSP is elucidated with respect to 
Fig. 7 and with respect to its combination with the inverse texture mapping (see Fig. 8), 

The use of a rasterizer RA in the t^ture space TSP is elucidated with respect 
25 . to Fig. 9 and with respect to its combination with the forward texture mapping (see Fig. 10). 

Fig. 7 elucidates tiie san^ling in the direction of the displacement vector in the 
screen space. The real world object WO moves in a certain direction. This movement of the 
complete object WO causes the grs^hics primitives (the polygons A and B) to move also. 
The movement of the polygon A can be indicated in the screen space SSP by the 
30 displacement vector SDV of the polygon SGP. Oth^polygons of the real wodd object WO 
may have other displacement vectors. The intensities PH of the pixels Pi are resampled such 
that xesan]pled pixels RPi are determined which are positioned in a rectangular grid of which 
one direction coincides with the direction of the displacement vector SDV. The pixels Pi are 
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indicated by dote, the 

Ij^ampied^pKeWs^-aieishowifc ■ '■ 

The pixels Pi tff wWch the intensities PD detennine Ihe imag^ 
positioned in the orthogonal coordinate space defined by the orthogonal axi s x and y . The 
^^^^^ ^ areposftioned in fbe orthogonal coordinate ^ce defined by the 

Fig. 8 shows a block diagram of a circuit in accordance with an embodiment 
of the invention comprising the inverse texture mapping. 

The sampler RSS, which is the sampler RA shown in Kg. 6 which samples in 
the screen space SSP. samples within apolygon SGP in the direction of the displacement 
vector SDV of this polygon SGP to obtain resair^dedpaels RPi. Therefore, the sandier RSS 

receives the geometry of the polygon SGP and fte displacement information DI from the 
displacementprovidingcircuitDIG. The displacement infomiationDI may conqaise the 
direction in which the displacement occurs and the amount of displacement and thus may be 
the displacement vector SDV. The displacement vector SDV may be suppKed by the 3D 
application, or may be determined by flie displacement providing circuit DIG from Ae 
position ofthe polygon A in successive fiames. The resampled pixels RPi occur in an 
equidistant orthogonal coordinate space of positions which are aligned with the displacement 
vector SDV. Or said differently, the coordinate system x, y in the screen space is rotated such 
tiiat a rotated coordinate system x'. y' is obtained of which the x' axis is aligned with the 
displacement vector. _ 

The inverse texture m^q)er JTM receives the resan5)led pixels RPi to supply 
intensities Rip. The inverse texture mapper ITM operates in the same manner as the well 
known inverse texture mq,ping as elucidated with respect to Figs. 2 and 3. But, instead of Ae 
coordinates of the pixels Pi. the coordmates of the resampled pixels RPi are used. Thus, the 
footprint FP of the filter in the screen space is now defined in the coordinate system which is 
aMgned with tiie screen displacement vector. This foo^irint is m^-tothe texture space 
where the texels withm both this mapped footprint and wifldn the polygon ore weighted 
according to the mappedfilter characteristics to obtain fl» intensity of the resampled pixel 
Rip to which tiie foo^jrint belongs. 

The one^iimensional filter ODF comprises an averager AV and a resampler 
RSA. The averager AV averages the intensities mp to obtain averaged intensities ARIp. The 
averaging is performed in accordance with a weighting function WF. The resampler RSA 
resamples tiie averaged intensities AR^p to obtain tiie intensities PK of the pixels Pi. 
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Fig. 9 elucidates the sampling in flie direction of the displacement vector in the 
texture space. The real world object WO moves in a certain direction. Tins movement of Hie 
complete object WO causes the graphics primitives (flie polygons A andB) to move also. 
The movement of the polygon A can be indicated in the texture space TSP by the 

5 displacement vector TDV of fee polygon TOP. Other polygons of fee real world object WO 

may have ofeer displacement vectors. The intensities of fee texels Ti are resampled such feat 

tesampled texels RTi are obtained which arepositioned in a matrix of which one direction 

coincedents wife fee direction of fee di^lacement vector TDV. The texels Ti are indicated 

by dots, fee resanq)led texels RTi are indicated by crosses. Only afeW texels Ti and 

10 resampled texels RTi are shown. 

The texels Ti of which fee intensities determine fee texture displayed are 

positioned m fee orthogonal coordinate space defined by the orfeogonal axis U and V. The 
resampled texels RTi are positioned in fee orfeogonal coordinate space defined by fee 
orfeogonal axis U' and V. A distance DIS between two samples (texels Ti) in fee texture 
15 space is indicated by DIS. 

Fig. 10 shows a block diagram of a circuit in accordance wife an embodiment 

of fee invention comprising fee forward texture mapping. 

The sampler RTS, which is fee sampler RA shown in Fig. 6 which samples m 
the texture space TSP, samples wifein a polygon TOP in fee direction of fee displacement 
20 vector SDV of this polygon SGP to obtain fee resampled texels RTi. Therefore, fee sampler 
RTS recwves fee geometry of fee polygon TOP and fee displacement information DI firom 
fee di^lacement providing circuit DIG. The displacement information DI may comprise fee 
direction in ^ch fee displacement occurs and fee amount of displacement and feus may be 
fee displacement vector TDV. The di^lacement vector TDV may be suppUed by fee 3D 
25 plication, or may be determmed by fee displacement providing circuit DIG fixMn fee 
position of fee polygon A in successive fiamM. 

The interpolator IP inteipokites fee intensities of fee texels Ti to obtain fee 

intensities Rli of fee resampled texels RTi. 

The one-dimensional filtering ODF comprises an averager AV which averages 
30 fee intensities RB in accordance wife a weighting fanction WF to obtain filtered resampled 
texels FTi to which is also referred as filtered texels FTi. 

The mapper MSP m^s fee filtered texels FTi wifedn fee polygon SGP (in 
more general also referred to as fee gnq^hics primitive) to fee screen space SSP to obtain fee 
mt^ed tffltels MTi (see Fig. 4). 
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The calculator CAL deteiinines the intenaty canti^ 

of a pre-filter PRF (see Fig. 1 1) covers one of the m^»ped texels MTi. The intensity 
contributions depend on flie characteristics of Ae pre-filter PRF. For example, if fte pre-fiUter 
5 has a cubic an5)litude characteristic and if a mapped texelNTTi is very n^ 

mapped texel is at the border of flie footprint FP of the prefilter which is centered at a pixel 
Pi, the contribution of the mapped texel MTi is relatively small. If flie mapped texel MTi is 
not within the footprint FP of the prefflter of a particular pixel Pi, this mapped texel MTi will 

10 not contribute to the intensity of the particular pixel Pi. 

The calculator CAL sums all the contribution of the different m^ed texels 
MTi to the pixels Pi to obtain the intensities PE of the pixels Pi. The intensity PH of a 
particular pixel Pi only depends on the intensities of the mapped texels MTi within ftie 
foo^rint FP belonging to this particular pixel Pi and the ampHtude characteristic of the pre- 

15 filter. Thus for a particular pixel Pi only the contributions of the m^iped texels MTi wifliin 
the footprint FP belonging to this particular pKd Pi need to be summed. 

Fig. 1 1 shows an embodiment of a blurring filter with a footprint The bhming 
filler (also referred to as pre-filter) PRF, which in Fig. 1 1 filters in the screen space SSP, has 

a foo^ttint EP. The footprint FP is the area of the filter PRF in the x and/or y direction in 
20 which a m^ed texel MTi contributes to a pixel Pi. The filter PRF is shown for a pfacel Pi at 
a positicm Xp in the screen space SSP. In the exanqde of the filter PRF shown, the footprint 
FP is four pixel distances, wide and covers in the x-direction the positions Xp-2, Xp-1, Xp, 
Xp+1, Xp+2. A mapped texel MTi which is nw^jped at the position Xm will contribute to the 
pixel Pi at the position Xp with the intensity of the mapped texel MTi multipUed with the 
25 filter vahieCOl. 

Fig. 12 shows the determination of a displacement vector of a polygon based 
■■ on the displacement vectors of vertices of the polygon. The polygon SGP in the screen space 
SSaP has vertices VI, V2, V3, V4 to which the displacement vectors TDVl, TDV2, TDV3, 
TDV4, respectively, are associated. Preferably, the displacement vector TDV for all ihe 
30 pixels Pi withm the polygon SOP is the average of the displacement vectors TDVl, TDV2, 
TDV3, TDV4. Thus, the displacement vectors TDVl, TOV2, TDV3, TDV4 are vectorially 

added to obtain both the direction and the anqalitude (after division by the number of 
vertices) of the displacement vector TDV. . 
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More coinplex ^iproaches are possible, f<» example, if Ihe diqjlac^ 
vectors TDVl, TDV2, TDV3, TDV4 are largely different, the polygon may be divided in 
smaller polygons. 

Fig. 13 shows the temporal pre-filtering using stretched pixels in accordance 
with an embodiment of the invention. The one-dimensional filter ODF is performed by first 
distributing the intensities Rip of the resan^led pixels RPi in the direction of the 
displacement vector SDV. The distiibution of the intensity Rip is performedin an area 
around the associated resan5)led pixel RK such fliat Ihe local intensity Rip is spread out over 
this area. The dimensions of flie area are determined by the magnitude of the displacement 
vector SDV. This spreading out of the intensity Rip is also referred to as stretching flie pixels 
Pi. As an exanq>le only. Fig. 13 shows a motion displacement which is 3.25 times tiie 
distance between two adjacent lesampled pixels RPi. The pixel stretching in the x' direction 

(see Fig. 7) is elucidated. 

In Fig. 13 A, the intensities Rip of the lesampled pixels RPi are distributed or . 
stretched as indicated by the horizontal lines indicated by Dli. Each dot on the x'-axis 
indicates tiie position of a resanq»led pixel RPi The lines DB show that the mtensity Rip of 
each of the resampled pixels RPi is distributed to cover anoflier one of resampledpfacels RPi 
bofli at the left hand side and at flie right hand side of each of the resampled pixels RPi. 

Fig. 13B shows the average of the oved^ing distributed intensities Dli. 
Fig. 14 shows the ten^ral pre-filtering using stretched texels in accordance 
with an embodiment of the invention. The one-dimensional filter ODF is performed by first 
distributing the mtensities Rli of the resampled texels RTi in the direction of tiie 
displacement vector TDV. The distiibution of the intensity RH is performed in an area around 
the associated resampled texel RTi such that fte local intensity RH is spread out over this 
area. The dimensions of the area are determmed by the magnitude of the displacement vector 
TDV. This spreading out of the intensity RB is also referred to as stitstching the resampled 
texels RTL As an example only, Fig. 14 shows a motion displacement which is 3.25 times tiie 
distance between to adjacent resanipled texels RTi. The texel stretching m the U» direction 

(see Fig. 9) is elucidated. 

In Fig. 14A, the intensities Rli of the resampled texels RTi are distributed or 
stretched as indicated by the horizontal lines indicated by TDH. Each dot on flie U'-axis 
indicates the position of a resampled texel RTi. The lines TDB show that the intensity RD of 
each of the resampled texels RTi is distributed to cover anotiier one of resampled texels RTi 
both at the left hand side and at the right hand side of each one of the resampledlexels RTi. 
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Rg- 14B shows the average FTi of the overlying distributed intensiti^ TDH, 

rr„-^..... TheVstrefchedJtexefe^ — - 

fidnie sample interval is larger than the distance between two adjacent resanqiled texels RTi 
Hie piece-wise constant signal FTi which is obtained by averagmg flie overlying parts of 
5 the distrtbuted intensities TDD is a good approximation of the time-continue integration of a 

.„ ^m^,.^"^. be/explai^^ 15. T&us,_1heiesultof the texel stretching- is ^ 

a blur which resembles the blur of a traditional camera. This blur is very acceptable to a 
viewer. If the stretched texels are not ov^l^ing due to no or a small amount of motion, no 
motion blur is generated and a spatial box reconstruction is obtained. 

10 Fig. 14 illustrates the averaging of the overlapping parts of the distributed 

intensities I5li for a motion displacement of 3.25 times the mapped texel distances. The 
obtained piece-wise constant signal FTi is an approximation of an integrated signal. It is 
possible to view the piece-wise constant signal FTi as a box reconstruction of artificial 
samples that represent the averaged overlapping parts. The artificial samples depend on a 

15 varymg number of overlapping stretched texels. In Fig. 14, either three or four stretched 
texels overlap. This can be avoided by restricting the edges of the stretched texels to the 
resampled or mapped texel positions RTi. Thus, a motion bhjr &ctor is used which is an 
integer multiple of the distance between r^ampled texels RTi. 

Fig. 15 shows the approximation of motion blur of a camera by using the 

20 stretched texels in accordance witii an embodiment of the invention. Fig. 15A shows a texel 
stretching of eight ms^yped texel distances. The line indicated by tb shows the positions of the 
resampled texels RTi in the U* dnection for a particular firame. The line indicated by te 
shows the positions of the resampled texels RTi in the U' direction for a fiame succeeding 
the particular frame. The distributed intensities RH are indicated by the lines TDK. The 

25 resulting piece-wise constant intensity FTi is shown in Fig. 15B. The solid lines indicated by 
CA show the motion blur introduced by a camera. 

To conclude, in a preferred embodiment, the invention is directed to a method 
of generating motion blur in a 3D-graphics system. A geometrical information GI defining a 
sh^ of a graphics primitive SGP or TOP is received RSS; RTS from a 3D-^plication. A 

30 displacement vector SDV; TDV defining a direction of motion of the grs^hics primitive SGP 
or TGP is also received fi*om the 3D-application or is determined fix>m the geometrical 
information. The graphics primithre SGP or TGP is sampled RSS; RTS in the dfrection 
indicated by the displacement vector SDV; TDV to obtain ii^jut samples RPi, and an one 
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dimensional spatial ffltering ODF is performed on Uie input samples RK to obtain tenqporal 
pre-filtering. 

It should be noted that the above-mentioned embodiments illustrate laflier than 
limit the invention, and that those skilled in the art will be able to design many alternative 
embodiments without departing from the scope of the appended claims. For example, in 
many of the embodiments above, the processing of only one polygon is elucidated. In a 
practical appHcation a huge amount of polygons (or more general: gr^hics primitives) may 
have to be processed for a complete image. 

In tiie claims, any reference signs placed between parenthesis shall not be 
construed as limiting ttie claim. The word "comprisiniT does not exclude flie presence of 
other elements or steps than those listed in a claim The invention can be implemented by 
means of hardware comprising several distinct elements, and by means of a suitably 
programmed computer. In the device claim enumerating several means, several of tiiese 
means can be embodied by one and the same item of hardware. 
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CLAIMS: 



1 ^ A method of generating motion blur in a grapliics system, the method 

comprising: 

receiving (RA; RSS; RTS) geometrical infiomation (GI) defining a shape of a 

gr^hics primitive (SGP,TGP), 
5 - providing (BIG) displacement information (pi) determining a displacement 

vector (SDV;TDV) defining a direction of motion of the graphics primitive (SGP; TGP), 

sampling (RA; RSS; RTS) the graphics primitive (SGP; TGP) in the direction 
indicatedby ibe displacement vector (SDV;TDV) to obtain input samples (RPi; Rli), and 
one dimensional spatial filtering (ODF) of ihe hq?ut samples (RPi; RH) to 
10 obtain temporal pre-filtering. 

2. A method as claimed in claim 1, wherein the step of providing (DIG) 
displacement mfbnnation (DI) fiirther defines an amount of motion of flie gr^hics primitive 
(SGP; TGP), and wherein the step of one dimensional spatial filtering (ODF) is arranged to 

15 obtain tiie temporal pre-filtering witii a size of afilter foo^oint (FP) that depends on the 
magnitude of the displacement vector (SDV;TDV). 

3. A metiiod as claimed in claim 1, wherein die displacement vector (SDV;TDy) 
is siqjpliedby a 2D or a 3D ^plication. 



20 
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4 A method as claimed in claim 1, wherein the step of providing (DIG) 

displacement information (DI) receives a model-view transformation matrix fix>m a 2D or. a 
3D {plication, said matrix defining the position and orientation of the gr^hics primitive 
(SOT; TGP) of a previous fi»me. 

5. A method as claimed in claim 1, ^erem the step of providing (DIG) 

displacement informafion (DT) buffers a position and an orientation of ihe gK?)hics primitive 
(SGP; TGP) of a previous fiame to calculate tiie displacement vector (SDV;TDV). 



PHNL030343EPP 

19 26.03.2003 

6. A method as claimed in claim 1, wherein 

intensity (PD) on a display screen (DS), the pixels (Pi) being positioned on pixel positions 
(x,y) in a screen space (SSP), 
5 - the step of sampling (RA; RSS; RTS) is ad^dfor sampling (RSS) in the 

screen space (SSP) in a direction ^ (SDV) bemgAe - - 

displacement vector mapped to the screen space (SSP) to obtain resampled pixels (RPi), 
the method fiirlfaer comprises an inverse texture mapping (TTM) receiving 
coordinates of the resampled pixels (RPi) to supply intensities (BOp) of the resampled pixels 
10 (RPi), 

the step of one dimensional spatial filtering (ODF) comprises averaging (AV) 
of the intensities (EUp) of the resampled pixels (EtPi) to obtain averaged intensities (ARIp) in 
accordance with a weighting function (WF), 

the method further comprises a resampling (RS A) of the averaged intensities 
15 (ARIp) of the resampled pixels (RPi) to obtain the pixel intensities (PK). 

7. Method as claimed in claim 1, wherein 

the graphics system is arranged for displaying pixels (Pi) having a pixel 
intensity (PE) on a display screen, flie pixels (Pi) being positioned on pixel positions (x,y) in 
20 a screen space (SSP), 

- . . the method further con:q>ri.ses providing appearance information (TA, TB) 
defining an appearance of the graphics primitive (SGP) in the screen space (SSP) by defining 
texel intensities (Ti) in a texture space (TSP), 

the step of sampling (RA; RSS; RTS) is ad^ted for sampling (RTS) in the 
25 texel space (TSP) in a direction of a texel displacement vector (TDV) being the displacement 
vector mapped to the texel space (TSP) to obtain resampled texels O^Ti), 

- the method finiher comprising interpolating (IP) the texel m 
obtain intensities (RB) of the resanqded texels (RTi), 

the st^ of one dimensional spatial filtering (ODF) coinprises averaging (AV) 
30 the intensities (RB) of the resampled texels (RTi) in accordance with a weighting function 
(WF) to obtain filtered texels (FTi), 

the me&od finrther coniprises: 

moping (MSP) the fiBtered texels (FTi) of the graphics primitive (TGP) in the 
texture space (TSP) to the screen space (SSP) to obtain m^ped texels (Mri\ 
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detennining (CAL) mtensily contributiom fixim 
the pixels (Pi) of which a coixesponding pre-filter footprint (PFP) of a pre-filter (PRF) covers 
the mapped texel (MTi), the contribution bang detemined by an ampKtude characteristic of 

the pre-filter (PRF), and 
5 - summing (CAL) the intensity contributions of the mapped texel (MTi) for 

each pixel (Pi). 

8. A mefliod as claimed in claim 6 or 7, wherein at least a direction of the 
displacement vector (SDV;TDV) of the graphics primitive (GP) is an average of directions of 

10 displacement vectors of vertices of tiie grs^cs primitive. 

9, A method as claimed in claim 6, wherein the step of one dimensional filtering 
(ODF) comprises: 

distributing, in the screen space (SSP), the intensities (Rip) of the resampled. 
15 pixels (RPi) in a direction of the displacement vector (SDV) over a distance determined by a 
magnitude of the displacement vector (SDV) to obtain distributed intensities (Dli), and 

averagmg overlapping distributed intensities (DB) of different pixels (Pi) to ; 
obtain a piece-wise constant signal being the averaged intensities (ARPi). 

20 10. A method as claimed in claim 7, wherein the step of one dimensi<Mial filtering 

(ODF) coniprises: 

distributing, in the teKtuie space (TSPX mtensities (RE) of the resampled 
texels (RTi) in a direction of the displacement vector (TDV) over a distance determined by a 
magnitude of the displacement vector (TDV) to obtain distributed intensities (TDH), and 
25 . averagmg overlying distributed intensities (TDB) of different resampled 

texels (RTi) to obtain a piece-wise constant signal being the filtered texels (Fli). 

II A method as claimed in claim 7, wherem the step of one dimensional spatial 

filtering (ODF) is arranged for applying a weighted averaging function (WF) during at least 
30 one frame-to-frame intexvaL 

12. A method as claimed in claim 9 or 10, wherein tiie distance is rounded to a 

multiple of Ihe distance (DIS) between resan5)led texels (RTi). 



PHNL030343EPP 



^ 21 26.03.2003 

13. A graphics computer system comprising: 



:indin^:f60ecei^ 



shape of a gr^hics primitiye (SGP,TGP), 

means for providing (DIG) displacement infomiation (DI) detomining a 
displacement vector (SDV;TDV) defining a direction of motion of the gr^hics primitive 

(^;Tc^ : : . . 

means for sampling (RA; RSS; RTS) the graphics primitive (SGP; TGP) in the 
direction indicated by the displacement vector (SDV;TDV) to obtain input samples (RPi; 
RE), and 

means for one dimensional spatial filtering (ODF) of the input samples (RPi; 
RB) to obtain temporal pre-filtering. 
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ABSTRACT: 



In a method of generating motion bhir in a SD-gcapidcs system, geometrical 
infbnnation (GI) defining a sh^ of a graphics primitive (GP) is received (RSS; RTS) fi?om a 
3D-appUcation. A displacement vector (SDV; TDV) defining a direction of motion of the 
graphics primitive (GP) is also received fix)m tiie 3D-appHcation or is determined ftom the 
geometrical information. The graphics primitive (GP) is sampled (RSS; RTS) in the direction 
indicated by the displacement vector to obtain input samples (EUPi), and an one dimensional 
spatial filtering (ODF) is performed on the input samples (RPi) to obtain temporal pre- 
filtering. 
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